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Abstract. The form and function of a collaborative assessment known as a "Buddy 
Quiz" is presented. The assessment is conducted in three successive phases over a 
contiguous 45- to 60-minute class period. A portion of each Quiz is completed in 
collaboration with one or two peers and a portion is completed without collaboration. 
The Quiz is primarily summative and is also designed to include formative aspects. The 
representation in the Quiz of the scientific enterprise as collaborative and individualistic 
O ' is discussed. The employment of this instrument in a ninth-grade (age 15 years) 

c/3 . conceptual physics course in an independent US secondary school is described and 

^~»' student feedback is presented. 

^ '. 
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1. Introduction 

Collaborative assessment is suggested to 
benefit the individual cognition of students 
(see, for example, [Ij). Peer involvement 
may take one of two general forms. (1) 
Cooperative: assigned social roles in a 
group whose members' scores depend on 
the success of the group in executing a well- 
structured task or (2) collaborative: an ill- 
structured episode of unconstrained discus- 
sion in which individual scores are unre- 
lated to group outcome [21 [3] . In this pa- 
per we describe a written assessment that 
leverages the latter form of collaboration. 
In the assessment described here, an in- 
dividual student is allowed unconstrained 
discussion with a peer concerning the mate- 
rial on a written quiz for which the individ- 
ual student will receive a grade unrelated to 
the peer. That is, the students are encour- 
aged, but not required, to use their peers 
as a resource on a summative assessment; 
deciding how to employ the peer resource 
on an assessment is a formative experi- 
ence. Following a description by Selker |3] 
of a collaborative assessment technique, we 
have devised and implemented the "Buddy 
Quiz" described in this paper. 

Our exposition of the Buddy Quiz in- 
strument is made in two contexts. First, 
the volume of literature is considerable on 
the subject of peer involvement in educa- 
tional psychology (see [S] for a review). In 
this light, we examine the Buddy Quiz on 
cooperative and collaborative grounds in 
terms of competitive and individualistic en- 
vironments and intend it to be collabora- 
tive and individuahstic. Second, we have 
designed the Buddy Quiz to support a view 
that a collaborative and individualistic en- 
vironment is an authentic representation of 



the "scientific enterprise," as recommended 
in policy statements by the National Re- 
search Council of the United States O E] 
and the American Association for the Ad- 
vancement of Science [S]. 

In Section |2] we describe the structure 
of the assessment instrument and the 
pedagogical motivations for its various 
aspects. In Section [3] we describe the 
implementation of the instrument in a 
secondary physics classroom, including 
student feedback. In Section H] we explore 
the Buddy Quiz as a representation of the 
professional scientific enterprise. 

2. Assessment Method 

The Quiz is administered in three phases 
during a 45- to 60-minute block. In this 
section we describe the logistics, goals, and 
motivations of each phase. The materials 
needed are (1) coloured pens for every 
student, in each of two distinct colours, and 
(2) a hard copy of the Quiz questions and 
answer sheet on which each student will 
write their work for submission. 

Buddy Quizzes are summative and the 
questions are written no differently than for 
a traditional written exam. That is, the 
Quiz is not a series of discussion prompts 
but rather a few traditional questions with 
definitive answers. For example. 

If two water drops drip succes- 
sively from a faucet, does the dis- 
tance between them increase, de- 
crease, or stay the same while 
they are both falling? 



or 



If a glass of water and ice cubes is 
filled to the brim with water, will 
it overfiow as the ice cubes melt? 
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or 

Is the mass of the Moon within 
one order of magnitude of 10^^ kg? 

are typical questions. The questions are 
generally qualitative in nature, although 
the method described here does not 
preclude quantitative questions. 

2.1. Individual Phase 

For approximately 15 minutes the students 
work silently on their own, completing 
the entire Quiz individually. For their 
work during this phase all of the students 
should use the same coloured pen. We use 
traditional, darker colours for this phase 
such as blue, green, purple, or maroon. 
At the end of the time, all of the pens 
are collected but the Quiz sheet with the 
individual work is left with the students. 

2.2. Collaborative Phase 

Partners are assigned randomly and the 
students change their seats in order to 
be next to their partner. Pens of a new 
colour are distributed, the same colour for 
everyone. We use lighter, editorial colours 
for this phase such as pink or orange. 
For approximately 15 minutes the students 
freely discuss the quiz material and amend 
their individual answers as they see fit, if 
at all, using the new pen colour. At the 
end of the time, all of the pens and all of 
the Quiz sheets are collected, leaving no 
materials with the students. 

2.3. Discussion Phase 

For the remaining time, the instructor 
and students have an open, class-wide 
discussion reviewing the answers to the 
questions on the Quiz. 



2.4- Scoring 

For correct answers provided in the first 
pen colour during the individual phase the 
students receive full credit. For correct 
answers given using the second pen colour 
during the collaborative phase, students 
receive half credit (or some other decreased 
value). For correct answers in the first 
colour that are crossed out in favor of an 
incorrect answer in the second colour, half 
credit is deducted. 

2.5. Pedagogical Motivations 

As a summative assessment, the availabil- 
ity of full credit during the first phase 
makes the Buddy Quiz no different than a 
traditional quiz for the student who is cer- 
tain of the correct answer. If certainty is in 
doubt and the collaborative phase provides 
the opportunity to gain or to lose points, 
then the Buddy Quiz is also a formative 
assessment (see, for example, ^). 

Indeed, behaviourally, the students 
are likely to ask each other "What did 
you get for number three?" at the 
conclusion of the assessment. The Buddy 
Quiz is designed to channel those questions 
from the close of the individual phase 
in to the collaborative phase. The 
students' adolescent desire to measure 
themselves against their peers is leveraged. 
Also, decision-making in a peer situation 
is brokered since points are still in 
jeopardy for amended answers. Whether 
or not a student is persuaded by their 
partner to amend their answer during 
the collaborative phase is a formative 
experience that encompasses life skills as 
well as the course material at hand. 

Although the Buddy Quiz offers the 
potential for formative development, a for- 
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mal study of student discourse during the 
collaborative phase is necessary in order 
to demonstrate formative development (for 
example, [ID]). That is, comments be- 
tween students during the collaborative 
phase such as "I cheated and looked in my 
notes; the answer is definitely C," repre- 
sent a different formative experience than 
"In the limiting case of large distances, the 
potential approaches zero from the positive 
side," or "Didn't we see a demo like this?" 
The anecdotal student feedback described 
in Section |3] is suggestive of the latter ex- 
planation; that the collaborations are for- 
mative of physical concepts and the scien- 
tific enterprise. 

2. 6. Variations 

The Buddy Quiz admits of variations in 
form and function. We have designed the 
instrument for a physics course using input 
from research in the instruction of natural 
sciences, but the Quiz seems portable to 
other subject matter. 

Also, changes in the scoring format 
may stress different aspects. For example, 
offering full credit for both the individual 
phase and the collaborative phase could 
make the assessment more formative. 
Development would be predicated on the 
students reflecting upon the Quiz phase in 
which the correct answer was determined. 
On the other hand, the Quiz could be 
made more competitive and summative by 
keeping track of which partners provide the 
greatest benefits to their collaborators over 
many assessments (and rewarding points 
accordingly) . 

We have only described examples of 
qualitative Quiz questions, but quantita- 
tive questions of arbitrary difficulty and 



rote mechanization are also used and may 
hold significant formative potential. Again, 
a study of the discourse is warranted for 
validation, especially if qualitative and con- 
ceptual commentary is expected. 

3. Practical Deployment 

3.1. Course Description 

In this section we describe the implemen- 
tation of the Buddy Quiz in two different 
classes, X and Y , of the same Physics First 
courselj These classes met four times each 
week for 30 weeks at different times of day 
in the same room that had five tables at 
which to work collaboratively. Section X 
had 11 students which necessitated four 
groups of two and one group of three. Sec- 
tion Y had 14 students which necessitated 
four groups of three and one group of two. 
The grades in the course are comprised 
of three equal parts: (1) 55-minute exams 
on which the students work individually, 
worth twice as much and given half as 
frequently as Buddy Quizzes, (2) Buddy 
Quizzes, and (3) individual lab reports 
on weekly exercises conducted in groups. 
Exercises which are not assessed include 
group discussions on workbook exercises 
(either from [TT] or [12]) and class- 
wide homework review sessions in which 
preparation is checked for completeness, 
not veracity. The grades in the course are 
not curved. 

3.2. Feedback 

3.2.1. Testimonials Our practice is to 
have the students write the questions that 
will appear on the course evaluation ques- 
tionnaire. The students each submit ques- 

I http://www.aapt.org/Resources/policy/physicsfirst.cfni 
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tions anonymously and the submissions are 
compiled into a questionnaire that is ad- 
ministered anonymously. In this way, both 
the answers and the questions are useful 
feedback. Interestingly, the following ques- 
tion appeared on the questionnaire for Sec- 
tion Y: "Do you like Dr. Hoffman's buddy 
quizzes more than regular quizzes?" The 
responses given in Table 1 were collected 
via anonymous web form after 25 weeks, 
after approximately ten Quizzes had been 
administered. 

3.2.2. Teaching Style Inventory We also 
administer the CORD Teaching Style 
Inventor j|§| to each student, asking each 
student to answer from the teacher's point 
of view. The students were surveyed 
anonymously on the same day in mid- April 
as the feedback in Table [H was collected. 
We present the results here in Figures 
1 & 2 for context on the instructional 
environment in which the Quizzes are 
given. 

Figure 1 shows that, despite a rela- 
tively heavy assessment regimen, the stu- 
dents consider the instruction to favour 
understanding rather than rote learning. 
Similarly, Figure 2 shows that enactive 
processing is perceived over the symbolic 
processing required of abstracted lectures. 
When interpreting the interaction axis, it is 
important to note that the text of the TSI 
describes explicitly cooperative, not collab- 
orative, environments. 

4. Discussion 

In designing the Buddy Quiz, we have 
attempted to expose students to the 
scientific enterprise, as recommended by 

§ http://www.texascollaborative.org/TSI.htni 



[HI El [7j. Thus, our design employed 
the answers to the following questions: 
Is the scientific enterprise collaborative or 
cooperative? Is the scientific enterprise 
competitive or individualistic? We use 
the standard definitions of these terms (for 
example, [2|[T3]): 

- collaborative: peer interaction is 
freely available, encouraged, but not 

necessary 

- cooperative: group members have 
defined roles in a defined task for 
which all group members receive the 
same reward 

- competitive: negative interdepen- 
dence in which only the highest per- 
formers are rewarded 

- individualistic: the opportunity to 
attain a reward is not diminished by 
the presence of capable peers 

Is the scientific enterprise collabora- 
tive or cooperative? We consider it to 
be collaborative. Research is not a well- 
structured task mainly because the out- 
come is not known. The authorship of a 
paper, unlike the membership of a coop- 
erative group, is typically uncertain until 
publication. Furthermore, the impact of 
the paper in the literature (the reward) is 
not dependent on any of the hallmarks of 
cooperation: the authors are not responsi- 
ble for ensuring that all of the coauthors 
have the same understanding of the mate- 
rial or the same share of the work load. 

Is the scientific enterprise competitive 
or individuahstic? We consider it to 
be individualistic. A classic competitive 
environment is one in which test scores are 
curved; the few "curve breakers" at the 
top will be rewarded while all other peers' 
rewards suffer because of the presence of 
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the high achievers. In scientific research, 
there is no a priori hmit to the number of 
papers that can be published, no way for 
one researcher to preclude the success of 
another when empirical evidence is the only 
source of merit. Indeed, consider the free 
flow of ideas and suggestions at academic 
coUoquia. [HI US] 

Similarly, consider the ubiquitous 
analogy of swimming races for cooperative 
and competitive environments. A four- 
person relay race is cooperative in that 
all members must perform in order for a 
reward to be possible. A one-person race is 
competitive in that the only way to deflne 
a winner is to deflne everyone else as losers. 
Races are won by the one person or team 
that subjectively beats the rest of the fleld; 
one need not perform well, merely better 
than everyone else. In contrast, scientiflc 
research papers are published only when 
the content rises above a level of objective 
merit, independent of others in the fleld. 

Do peers in science exhibit competi- 
tion in the vernacular sense? Yes, of course. 
Do politics end up favoring some peers over 
others for non-objective reasons? Yes, of 
course. [16] For example, one important ex- 
ception to a collaborative and individual- 
istic scientiflc enterprise occurs in a race 
to a fundamental (and expensive) discov- 
ery: rather than exhibiting the incremental 
improvement that typifles science, cooper- 
ation governs the enterprise with interna- 
tional research agencies authoring papers 
jointly, as in the fleld of experimental par- 
ticle physics. However, for the most part, 
the scientiflc enterprise is not a competi- 
tive environment in the pedagogical sense 
in which peers are hazardous adversaries, 
rather it is individualistic in which peers 
are a resource. 



Contrary to our current model, oth- 
ers have modelled professional science as a 
cooperative interplay among non-scientiflc 
institutions. [TTJ [161 Ell [IS] Indeed, a con- 
tract for "basic research" between a gov- 
ernment agency and a private corpora- 
tion is cooperative in that the legal con- 
tract is necessarily a well-structured task 
with well-deflned roles and a result deter- 
mined in advance. We do not claim that 
the Buddy Quiz reproduces the societal 
and political dynamics of these coopera- 
tive models, in part because the cooper- 
ation in these contracts is among agen- 
cies, not the individual scientists. With 
the Buddy Quiz, we are seeking to emulate 
the pure scientiflc enterprise exemplifled by 
academic research in flelds with few ties to 
industry (for example, astronomy). |20] In 
the terms of Collins and Evans [21], the 
students are expected to possess interac- 
tional expertise and are assessed on their 
level of contributory expertise. 

The collaborations in a Buddy Quiz 
are limited to small groups in the interest 
of time and in order to attain and focus 
the conceptual beneflts of the interaction 
for each student. Although the scientific 
enterprise might be better emulated by let- 
ting all students mingle freely in search of 
a consensus answer to each Quiz question, 
in such an environment we feel that stu- 
dent retention and conceptualization would 
likely suffer without considerable remedial 
incentivization atypical of the scientific en- 
terprise. Rarely would a research discus- 
sion be restructured in order to accommo- 
date the least capable and least engaged 
member; a research group can expel incom- 
petent members but not a physics class its 
students. 



The Buddy Quiz 

In a Buddy Quiz, each student will 
submit their own "paper" with their 
own name as first author and they will 
individually and objectively succeed or 
fail on decisions they made concerning 
use of internal and external resources. 
The attainment of the correct answer 
is tantamount, whether it comes after 
revision is secondary. The format is overtly 
summative and individualistic. Judging 
from the narrative feedback in Table [1], 
the students perceive the assessment as 
such and overwhelmingly welcome it. 
In addition, formative development is 
apparent in students who lament losing 
points after nullifying correct answers 
during the collaborative phase. 

5. Conclusions 

The "Buddy Quiz" is a collaborative as- 
sessment that uses standard test questions, 
two colours of pen for written student work, 
and sufficient time to allow for peer collab- 
oration and instructor-led discussion. The 
design of the Quiz is intended to include 
both the social-behavioural and the cogni- 
tive benefits of peer learning. The tech- 
niques and content of the Buddy Quiz are 
consistent with recent studies of instruction 
in the natural sciences and with recommen- 
dations from the scientific academy. 
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Table 1. Student feedback from Section Y 



Responses to: Do you like Dr. Hoffman's buddy quizzes more tlian regular quizzes? 

• yes! 

• Yes because you can see the thought process of other students 

• Yes i do like that they are buddy quiz because i feel that if it were just 
me taking the quiz i wouldnt learn as much, when i get paired up with a 
partner they explain it to me and help me understand waht i did wrong, i 
also like it because i can get points back with a buddy that i wouldnt be 
able to do if i was alone. 

• Yes 

• yes, much more 

• personally, i think buddy quizzes are more hurtful to my grade because 
working with a buddy is not helpful to me. 

• Yes 

• I have no preference 

• Yes. The ability to have another person to bounce ideas off of is quite 
helpful in the learning experience as we can take it from more than one 
perspective. 

• I like them more sometimes but it isn't always fair if you are placed with 
a weaker partner when others are getting much stronger partners. 

• Yes it gives us a better chance to do well and learn. 

• yes ! 

• Yes, they allow you to correct mistakes and still get some credit. 

• yes 
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Concept Representation 



Figure 1. Teaching Goals Matrix. Student responses to the Teaching Style Inventory 
described in Section |3] for two classes. The triangles represent Section X {N = 10), 
the circles represent Section Y {N = 14), and the square represents the instructor (the 
author of this paper) . 
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Figure 2. Teaching Methods Matrix. Student responses to the Teaching Style 
Inventory described in Section [3] for two classes. The triangles represent Section X 
{N = 10), the circles represent Section Y {N = 14), and the square represents the 
instructor (the author of this paper) . 



